Multimodal Construction Grammar
نویسندگان
چکیده
منابع مشابه
Integration of Speech and Deictic Gesture in a Multimodal Grammar
In this paper we present a constraint-based analysis of the form-meaning mapping of deictic gesture and its synchronous speech signal. Based on an empirical study of multimodal corpora, we capture generalisations about well-formed multimodal utterances that support the preferred interpretations in the final context-of-use. More precisely, we articulate a multimodal grammar whose construction ru...
متن کاملA Memory-Based Approach to the Treatment of Serial Verb Construction in Combinatory Categorial Grammar
CCG, one of the most prominent grammar frameworks, efficiently deals with deletion under coordination in natural languages. However, when we expand our attention to more analytic languages whose degree of pro-dropping is more free, CCG’s decomposition rule for dealing with gapping becomes incapable of parsing some patterns of intra-sentential ellipses in serial verb construction. Moreover, the ...
متن کاملModeling and Interpreting Multimodal Inputs: A Semantic Integration Approach
Modern user interfaces can take advantage of multiple input modalities such as speech, gestures, handwriting... to increase robustness and flexibility. The construction of such multimodal interfaces would be greatly facilitated by a unified framework that provides methods to characterize and interpret multimodal inputs. In this paper we describe a semantic model and a multimodal grammar structu...
متن کاملImplementing Tabular Deduction for Multimodal Logical Grammar
The paper proposes a method for tabular deduction for multimodal logical grammar, extending a method for linear logic presented in (Hepple, 1996; Hepple, 1998). Tabular deduction for multimodal logical grammar avoids redundant computation like chart parsing does for CFGs. The method discussed here enables one to process any kind of multimodal logical grammar fragment. An implementation of the m...
متن کاملChildren’s Multimodal Language Development
Through constant exposure to adult input, in dialogue, children’s language gradually develops into rich linguistic constructions that contain multiple cross-modal elements subtly used together for coherent communicative functions. In this chapter, we retrace children’s pathways into multimodal language acquisition in a scaffolding interactional environment. We begin with the first multimodal bu...
متن کامل